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P RE FACE 



This report, prepared at the request of the San Jose Unified 
School District, evaluates Project R-3, a demonstration program funded 
under California Assembly Bill-938 to raise the reading and arithmetic 
achievement of disadvantaged children. The bill provides special pro- 
grams for junior high school students. If projects are cost-effective, 
they will be re-funded for up to three years. 

The San Jose Unified School District asked Rand to evaluate the 
original R-3 program, which operated from February 1967 through June 
1969. At that time, outside evaluation was a relatively new concept. 
Because of Rand's objectivity as a third-party observer, we were able 
to provide feedback to the Program Director that was instrumental in 
improving the program. 

The current R-3 program continues and expands this program, de- 
veloped under California Senate Bill-28 for use in the eighth and ninth 
grades of the San Jose Unified School District. The program, success- 
fully carried out for a small group, now includes the entire seventh 
grade in one junior high school. The same students will participate 
in the program during the eighth and ninth grades. 

This report describes both the original and current programs and 
analyzes the data for the first semester of the new program, February 
through June 1970. The analysis reports on progress over the semester 
and provides detailed information on which the program director can 
base decisions for improving the program. 

To enable the educational planner to concentrate ort the effective- 
ness of alternatives, and to avoid obscuring information about program 
cost, effectiveness and cost are handled separately. The analysis of 
effectiveness serves to highlight the problems associated with quanti- 
fying measures of effectiveness when a program has multiple goals and 
diversified activities. A cost model was developed to allow the deci- 
sionmaker to explore the cost consequences of variations in the program 
as an aid to future planning. 
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SUMMARY 



Funded under California Assembly Bill-938, the current R-3 program 
is an expansion of a previously successful program to raise reading and 
arithmetic achievement of disadvantaged junior high school students. 

The basic concepts remain unchanged: motivational activities to pro- 

vide curriculum relevance; intensive involvements to improve teacher- 
student rapport; reading and arithmetic tailored to individual needs; 
and parental involvement in their children’s school activities. 

The previous program involved only a small number of students, ran- 
domly selected for participation, who were at least one but not more 
than two years below grade level in reading or arithmetic. New State 
guidelines stipulate that all students in the school’s seventh grade 
be included in the program and continue in it through the ninth grade. 

Program guidelines specified that students be grouped heteroge- 
neously. We developed a procedure for objectively accomplishing this 
grouping by forming 12 classes of 21 students, each reflecting the same 
range of achievement. This procedure is designed to be useful to any 
school district interested in a more rigorous method of forming compar- 
able groups that represent a range of achievement. For the purposes of 
research and evaluation, one can consider each group as a replication 
of an experiment and examine the impact of uncontrolled variables on 
these subgroups of the experimental population. 

Students were in the program for four months; during that period, 
average reading gain was five months, arithmetic, three. Students 
with the lowest entering scores, however, gained eight months in both 
subjects in that period. Whereas absences increased during the program, 
discipline referrals and suspensions decreased. (Since the students 
had been in the same school the fall semester with no special program, 
we were able to use them as their own controls.) 

Based on our own observation and extensive interviews with program 
personnel, we make several suggestions for improving the program. These 
are in the areas of program coordination, student orientation to the pro- 
gram, facilitation of achievement gain, and restructuring of the inten- 
sive involvements. 
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The evaluation of the R-3 program also considers the problem of 
cost-effectiveness. The program resources required and the achieve- 
ment resulting from the use of these resources were analyzed to deter- 
mine which resources contributed to achievement. To help in this 
determination, a cost model for assessing the impact of change in re- 
source allocation was developed. 

Since it is beyond the state of the art to realistically handle 
cost and effectiveness simultaneously, they are treated separately. 

The use of a single measure, or cost-effectiveness ratio, usually ob- 
scures needed information about the cost of a program as well as its 
effectiveness. Using the cost model frees the decisionmaker to concen- 
trate his attention on assessing the effectiveness of the program. 
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I. INTRODUCTION 



THE ORIGINAL R-3 PROGRAM 

To better understand the current R-3 program, we present a descrip- 
tion of the original program, which lasted from February 1967 through 
June 1969. Under the provisions of California Senate Bill-28 for dem- 
onstration programs to raise reading and mathematics achievement, the 
San Jose Unified School District (SJUSD) was granted State funding in 
1>67 to develop such a program. The State guidelines recommended that 
school districts enlist the cooperation of industry in developing pro- 
grams and encouraged districts to seek outside evaluations. 

Program Components 

Four elements were considered essential for improved achievement 
in the target population: motivation, more specifically defined as 

showing the relevance of classroom work to "the real world"; good re- 
medial instruction in English and arithmetic; intensive involvements 
to improve rapport between teachers and students; and parent involve- 
ment in their childrens 1 school activities. 

SJUSD engaged Lockheed Missiles and Space Company (LMSC) to pre- 
pare motivational activities for use with eighth-grade underachievers, 
predominantly Mexican -American. SJUSD believed that their teachers 
could handle the remedial work, but that something more was needed to 
reach the students. In order to participate in the LMSC activities, 
the students needed better facility in arithmetic and needed to im- 
prove their reading ability. Together with LMSC, the program teachers 
planned the motivational activities. The program teachers designed the 
remedial reading and arithmetic programs to prepare the students for 
the motivational activities. In addition, they used a diagnostic- 
prescriptive approach to tailor each student’s remedial work to his 
individual needs. All activities were planned around the fr World of 
Work" theme. LMSC’s motivational tactic was to simulate In the class- 
room many of the skills necessary to hold a job in our technological 
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society. The instructional activities of the R-3 program were sched- 
uled for three consecutive hours daily. 

The students took many trips to local industries, where they saw 
people from their own community at work. They then engaged in class- 
room activities designed to simulate the job performances observed. 

There were two other important aspects to the program. First, 
on two occasions during the school year, the students were taken for 
four days to a remote site, where they participated in an intensive, 
highly structured learning unit, developed around a theme suitable 
to the locale. One theme developed around a "Land Grant Game," which 
made use of many mathematical skills involved in surveying and re- 
quired English skills in writing applications for land grants. The 
students were housed and fed in dormitories at Pfeiffer Big Sur State 
Park. Another theme was oceanography. At Asilomar State Park, the 
students engaged in many of the activities of oceanographers, includ- 
ing measuring the salinity of tide pools and collecting, mounting, 
and correctly labeling specimens. 

These involvements served two basic purposes: They demonstrated 

to the students that learning could take place in any setting. Fur- 
thermore, they helped break down teacher-student barriers traditionally 
reinforced in the classroom. Teachers that participate in activities 
with their students, eat three meals a day with them, and share free 
time with them, develop a different relationship with students than is 
possible in the formal atmosphere of the classroom. It was hoped that 
both teachers and students would develop new perceptions of each other 
that would facilitate the learning process when they returned to the 
classroom. 

Second, the importance of involving parents in their childrens’ 
school experiences was recognized as a key factor in a successful pro- 
gram. Special evenings at the school stimulated parent participation 
in their children’s new learning experiences. They were also invited 
to accompany their children on the trips. 

Two SJUSD teachers were selected for the program, a math and a 
reading teacher. The 36 students involved were divided into 2 groups 
of 18. While one group was taught arithmetic, the other was taught 
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reading, The next hour, the classes were reversed. The third hour, 
all students participated in the R-3 motivational activities under the 
direction of both teachers, sometimes assisted by outside consultants. 

A second curriculum based on the same concepts was developed the 
following year by LMSC and SJUSD for the ninth grade. It was centered 
on the theme M You and Your Government." 



The criterion for the selection of teachers was that they be typi- 
cal of the average SJUSD reading and math teacher. No special attempt 
was made to recruit master teachers. From the inception of the pro- 
gram, SJUSD wanted to insure that the program could be replicated on 
a broader basis. Had they chosen master teachers, there would have 
been some doubt as to whether the success of the program was due to 
its nature or to the expertise of highly trained teachers. By their 
method of teacher selection, the latter possibility was, to a large 
extent, ruled out. 

The program had a full-time director whose main tasks were to 
(1) initiate and maintain close contact with parents of the partici- 
pants; (2) take an active role in the planning and evaluation of the 
curriculum in order to insure a smooth -running program; (3) direct 
the planning and implementation of the intensive involvements; and 
(4) coordinate the activities of LMSC, SJUSD, and The Rand Corpora- 
tion, the outside agency selected by SJUSD to do the evaluation. 

Student Selection 

In the fall, all eighth-grade students of average ability at 
Woodrow Wilson Junior High School (WWJHS) were administered the Cal- 
ifornia Achievement Tests (CAT) in reading and arithmetic. Those 
who scored at least one year, but not more than two years, below 
grade level on either test were eligible for participation in the 
program. Since replication was a program objective, it was neces- 
sary to choose a random sample of eligible students. To avoid bias- 
ing the sample by a consideration of other factors, Rand selected 
the students using a table of random numbers [1]. 



Staff 







At another SJUSD junior high school whose student body resembled 
that of WWJHS fairly well in terms of socioeconomic level, the CAT 
was also administered to all average-ability students. Only the prin- 
cipal of the school knew why these students had been selected for test- 
ing. At the end of the year, Rand randomly selected a comparison group 
from among those students who had been pre-tested. We used the same 
pre-test criteria as for the program students. These students were 
then administered the CAT post-test. This resulted in a double-blind 
experimental design because neither the students nor their teachers 
knew they were used as controls for an experimental program. 

Tables 1 and 2 show achievement results in the eighth grade for 
the 1967-1968 school year. Using analysis of covariance to control 
for differences in pre-test scores, the gains of the program group for 
boys and girls in both reading and airthmetic were significantly greater 
(at or beyond the 0.05 level) than those of the comparison group. 

There were measured decreases in student suspensions and referrals 
as compared to similar students in the same school. Attendance at and 
attitudes toward school improved, and parental involvement in their 
children* s school career increased. 

THE CURRENT R-3 PROGRAM 

California Assembly Bill-938 provided funds to continue demonstra- 
tion programs in arithmetic and reading. In January 1970, several of 
the original Senate Bill-28 programs, including R-3, were re-funded and 
some new ones were approved. 

Three new State requirements for funding have necessitated some 
extensive changes in the original R-3 program. First, in consecutive 
years, the program must be in the seventh, eighth, and ninth grades so 
that participants will have had a three-year exposure to these demon- 
stration programs. Second, and directly related to the above require- 
ment, all students in the school’s grade level must be included in the 
program. Consequently, all materials and activities must be adaptable 
to a very wide ability range. Finally, only those programs that are 
cost-effective will be re-funded. Section VI discusses this topic. 
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Table 1 

AVERAGE READING GRADE EQUIVALENTS FOR 
EIGHTH-GRADE PUPILS IN THE R-3 PROGRAM, 
FALL 1967 AND SPRING 1968 



Foys 


Girls 


Program 


Comparison 


Program 


Comparison 


Pre 6.7 


6.6 


6.9 


6.4 


Post 8.4 


7.9 


8.9 


7.5 


Gain 1.7 


1.3 


2.0 


1.1 



NOTE: N equals 33 for the program group, 

40 for the comparison group. 



Table 2 

AVERAGE ARITHMETIC GRADE EQUIVALENTS FOR 
EIGHTH-GRADE PUPILS IN THE R-3 PROGRAM, 
FALL 1967 AND SPRING 1968 



Boys 


Girls 


Program 


Comparison 


Program 


Comparison 


Pre 6.7 


6.5 


6.9 


6.7 


Post 7.9 


7.0 


8.3 


7.5 


Gain 1.2 


0.5 


1.4 


0.8 



NOTE: N equals 33 for the program group, 

40 for the comparison group. 



In the current R-3 program, the basic concepts of the original R-3 
program remain unchanged: motivational activities to provide curricu- 

lum relevance, intensive involvement, reading and math tailored to in- 
dividual needs, and parental involvement. However, there have been 
changes in their implementation to conform to the new guidelines. 

Although the level of funding was the same as for the demonstra- 
tion program, the greatly increased number of students required a vastly 
different allocation of resources. Major changes included (1) reduced 
expenditure for research and development because the program built on 
work done by LMSC for the original R-3, and (2) increased expenditure 
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for teaching staff. In addition, the intensive involvement was held 
+ , 

at a camp facility and much of the "housekeeping" was done by program 
staff and students. Finally, the number of field trips was reduced 
from about 20 to 4. The reduction in costs makes replication of the 
program by other districts more possible. 

In order to strengthen the core curriculum, a fourth hour was 
added to the program — humanities. The entire seventh grade was now in 
the R-3 program for all academic work. In addition, they had physical 
education and an elective subject, taught by the regular school staff. 

A teaching staff of 12 was necessary to create classes of about 
20 students for more individualized instruction. Seven teachers from 
the regular WWJHS staff indicated a desire to teach in the program. 

Five other teachers were recruited. Important criteria for the selec- 
tion of these five were a willingness to participate in an experimental 
program and a strong background in the teaching of reading. All three 
math teachers had been at WWJHS* and indicated a desire to become part 
of the R-3 staff. 

Twelve instructional aides were hired, one for each teacher. The 
ability to speak Spanish was listed as a desirable but not mandatory 
characteristic. Nine of the aides spoke fluent Spanish, a decided as- 
set both in dealing with bilingual students and in communicating with 
Spanish-speaking parents. 

Student Grouping 

SJUSD required that project participants be grouped heteroge- 
neously by ability. The CAT in reading and math was administered to 
all seventh graders in January 1970. It served as the pre-test for 
the measurement of achievement gain and also as the basis for group- 
ing students. Appendix A discusses how students were chosen in or- 
der to meet the heterogeneity requirement. As in the past, The Rand 
Corporation made the selections in order to insure that no extrane- 
ous factors would influence the assignment of students to groups. 

+ 

All districts do not have access to such facilities as Big Sur 
or Asilomar. 
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Student Scheduling 



t 



The two basic groupings of students in the program are (1) 3 teams 
of 80 students, taught by 4 program teachers, and (2) within each team, 
4 classes of 20 students, with the same combination of teachers. 

All students had a three-hour sequence of reading, humanities, 
and R-3, either in the morning or afternoon. Some had one teacher 
for all three classes, others had one teacher for R-3 and another for 
reading and humanities. All 80 students on each team had the same 
math teacher. 

Teachers of the same subject had the same period free. For exam- 
ple, there were no math classes scheduled the second or fifth periods. 
This enabled teachers to coordinate their planning. By scheduling 
several sections of a subject for the same period, provision is made 
for team teaching and for any special student re-grouping the teach- 
ers think advantageous for specific activities. 

The Evaluation 

The evaluation of Project R-3 is designed to serve two purposes. 
The first is an assessment of what was achieved relative to stated 
goals. To this end, data on achievement gain in reading and arith- 
metic are analyzed.^ In addition, attendance, referrals to the Vice- 
Principals, and suspensions are contrasted for the same students prior 
to and during their participation in the program. The rationale is 
that improved attitude toward school will be reflected in fewer 

+ 

The R-3 program is indebted to Mrs. Dorothy Shaw, the girl’s 
Vice-Principal of WWJHS, for devising a schedule of classes to permit 
maximum flexibility for both students and teachers* * 

*The use of gain scores for the measurement of true change is 
known to be inadequate and misleading. In our report for 1970-1971, 
regression techniques will be used to achieve a more reliable estimate 
of gains. 

A completely adequate approach would involve a statement of pro- 
gram objectives that is not based on achievement gain. An alternative 
that avoids the problems of change scores would be a statement of 
achievement goal. For a more complete discussion of the problem, see 
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disciplinary problems and increased attendance. These data are dis- 
cussed in Sec. II . 

The second purpose is to provide data that will be helpful to the 
Program Director in improving the program. There were many interviews 
with all program personnel. These were designed to elicit their opin- 
ions about the strengths and weaknesses of the program and are pre- 
sented in Sec. III. Our recommendations for improving the program, 
based on all available data and on personal observation by the evalua- 
tion staff, are presented in Sec. IV. 



0 

ERIC 



20 



-9- 



II. STUDENT DATA ANALYSIS 



ACHIEVEMENT GAIN 

In analyzing achievement gain, x^e included in the sample only 
those students for whom we have both pre- and post-test scores in read- 
ing and arithmetic, and who were pre-tested prior to 1 March 1970. 

Table 3 accounts for the difference between the number of students 
entering the program in February (253) and the number of students in- 
cluded in the analytic sample (219). 



Table 3 

PROGRAM ENROLLMENT AND ANALYTIC SAMPLE 



Students enrolled at beginning of program 253 
Students leaving program -24 

Students returning +3 

New students, February +3 

New students, post-February +6 

Total students at end of semester 241 

Less returnees and post-February 

new students -9 

Total eligible for analytic sample 232 

Students missing post-scores -12 

Student with ambiguous post-score -1 

Total available for analytic sample 219 



The differences in pre-test means between those computed on the 
original sample and those computed on the analytic sample are accounted 
for by these shifts in the student body. Table 4 presents these data. 
Although the overall pre-test means were not appreciably affected by 
the sample attrition, individual classes shifted by as much as six 
points in raitf-score means. 

OVERALL ACHIEVEMENT GAIN 

Table 5 shows overall achievement gain in reading and arithmetic. 
The standard scores were computed using [3]: 



O 
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z = 100 + 10 X 
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Table 4 

GROUP MEANS ON PRE-TEST FOR ORIGINAL 
AND ANALYTIC SAMPLES (RAW SCORES) 



Group 


Reading 


Arithmetic 


Original 


Analytic 


Original 


Analytic 


A-l 


55.5 


58.2 


47.0 


48.1 


A-2 


56.7 


62.8 


47.8 


50.6 


A-3 


61.4 


57.6 


48.9 


47.9 


A-4 


55.6 


55.0 


46.3 


46.0 


B-l 


56.3 


56.4 


47.3 


48.0 


B-2 


57.4 


55.0 


47.3 


46.8 


B-3 


58.9 


58.6 


47.2 


47.2 


B-4 


56.7 


57.5 


47.8 


46.7 


C-l 


56.3 


50.2 


44.3 


40.6 


C-2 


59.3 


61.2 


50.9 


53.6 


C-3 


59.8 


59.1 


46.3 


45.7 


C-4 


56.5 


55.4 


46.9 


45.6 


Overall 


57.5 


57.2 


47.3 


47.2 



Table 5 

OVERALL ACHIEVEMENT GAIN, PROJECT R-3 





Reading 


Arithmetic 




Pre 


Post 


Gain 


Pre 


Post 


Gain 


Raw score 


57.2 


63.1 


5.9 


20.9 


24.8 


3.9 


Standard score 


92.6 


92.8 


0.2 


91.0 


90.4 


-0.6 a 


Grade equivalent 


6.1 


6.6 


0.5 


6.6 


6.9 


0.3 



^ote the negative standard-score gain for arith- 
metic. The interpretation is that, although there 
was an absolute gain, it was less than would be ex- 
pected if the WWJHS seventh grade embodied the same 
characteristics as the norming population and if the 
traditional instructional format were used. 



where X^ is the local raw-score mean 
Sp is the publisher’s standard deviation. The publisher’s mean was 
interpreted to be the raw scores corresponding to grade placements of 
7.5 for the pre-test and 7.9 for the post-test. The CAT Manual did 



, Xp is the publisher s mean, and 




22 
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not provide the standard deviation for the seventh grade; we used the 
eighth-grade standard deviations, which are probably larger [4]. 





Reading 


Arithmetic 




Post 


Pre 


Post 


Pre 


Publisher’s mean 


81.5 


76.0 


75.5 


67.5 


Publisher’s standard 
deviation 


25, 


.5 


22.5 



Before interpreting these gains, note: 

1. A four-month period of instruction between pre- and post-tests. 

2. Because there was no lead time between funding and implemen- 
tation, students did not have the advantage of coming into a 
coordinated, preplanned program. Materials were developed 
as the semester progressed. 

3. Because the results of the diagnostic testing in reading were 
not available until April 23, students had the benefit of 
reading programs tailored to their needs for only about half 
the instructional period. 

4. The original R-3 program did not make the kinds of achieve- 
ment gain in its initial semester that it did during the first 
full year of operation. 

In our opinion, it is too early to judge the program’s potential. 
Achievement Gain by Sep tiles 

In order to divide the seventh grade into 12 classes, each reflec- 
ting heterogeneous grouping by achievement, we ranked students on the 
basis of their pre-test scores. For both arithmetic and reading, we 
calculated the achievement gain for each of the seven classifications. 
Table 6 presents these data. Note that while there is some overlap 
between the two rankings, the students in any given septile for read- 
ing are not necessarily the same, students as those in the correspond- 
ing arithmetic septile. 
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Table 6 

ACHIEVEMENT GAIN BY SEPTILES IN 
READING AND ARITHMETIC 3 



Septile 


Reading 


Arithmetic 


Pre 


Post 


Gain 


Pre 


Post 


Gain 


i 


9.0 


9.5 


0.5 


8.2 


8.6 


0.4 


2 


7.2 


8.1 


0.9 


7.2 


7.4 


0.2 


3 


6.5 


7.1 


0.6 


6.8 


6.9 


0.1 


4 


5.8 


6.1 


0.3 


6.3 


6,6 


0.3 


5 


5.2 


5.3 


0.1 


6.0 


6.3 


0.3 


6 


4.5 


4.9 


0.4 


5.7 


6.2 


0.5 


7 


3.6 


4.4 


0.8 


4.9 


5.7 


0.8 



For ease of interpretation, all gain 
scores are reported in grade equivalents. 
All computations are made using individual 
raw scores; the conversion is made using 
group mean raw scores. 



The patterns of achievement gain are somewhat different for the 
two subjects. As expected, the greatest gains in arithmetic were made 
by the students with the lowest entering scores. In reading, this 
group also made large gains, but they were exceeded by those in the sec- 
ond septile. Table 6 illustrates the tremendous range of achievement 
in the seventh grade and serves to highlight how information may be 
lost by reporting only overall achievement gains. Nevertheless, there 
is no strong evidence that the distribution of gains over the sep tiles 
is other than random. 




Comparison Groups 

No pre-tests were administered to any group of comparable students. 
A post- test was administered to a group of seventh-grade students in 
another junior high in the district. A t-test between the means of 
the program and comparison groups showed no significant difference.^ 

This was the only group available for comparison and we do not think 
it was appropriate because: 

^WWJHS actually performed better than the comparison group, but 
the significance level was only 0.3. 
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1. The other junior high is not a Title I school; WWJHS is, 

2. The other school has a much smaller percentage of Mexican- 
American students (27.4 percent) than does WWJHS (72.8 per- 
cent);^ thus the assumption that both groups can be regarded 
as samples from the same population is violated. 

3. The students to be post-tested at the other junior high were 
selected on the basis of their entering sixth-grade reading- 
achievement scores. Therefore, a test at the end of the 
seventh grade may be measuring differences in sixth-grade as 
well as seventh-grade learning experiences. 

Achievement by Class 

Since all 12 classes were initially very evenly matched on the 
basis of pre-tests, we were interested in seeing if achievement gain 
would be comparable from class to class. Therefore, we computed 
gains-scores by class (Table 7). Since we do not wish to invite com- 
parisons among the program staff, we are presenting no individual data, 
but are reporting ranges of gain and frequency of classes making each 

Table 7 

ACHIEVEMENT GAIN BY CLASS IN 
READING AND ARITHMETIC 



Mon ths 
Gain 


Reading 


Arithmetic 


Number 

of 

Classes 


Number 

of 

Classes 


i 


0 


i 


2 


4 


3 


3 


1 


3 


4 


1 


2 


5 


2 


3 


6 


3 


0 


7 


1 


0 



t 



Racial and ethnic survey of 10 October 1968, 



SJUSD. 
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gain. Reading ranged from two to seven months gain, arithmetic from 
one to five. 

It is too early in the program to do more than speculate about 
the reasons for these apparent differences. Obviously, there are dif- 
ferences among teachers — their personalities, their interact ions with 
different kinds of students, the class atmosphere they create, their 
ability to implement a new program. Next year, a comparable analysis 
should be made to further explore why some classes — or teachers — are 
more successful. If certain characteristics of teachers are more de- 
sirable for this kind of program than others, an attempt should be 
made to describe them. This will not be easy. From casual observa- 
tion, there seem to be as many differences within the group of teachers 
who achieved good results as between those groups of teachers who did 
and did not achieve good results. For the moment, we merely wish to 
acknowledge that these differences exist. 

Mo rning Versus Afternoon Classes 

In our search for systematic differences in the results, we spec- 
ulated about the possible influence of time of dav. We explored three 
ways of making this comparison: 

1. Three of the reading teachers taught one class in the morning 
and one in the afternoon. Table 8 shows the gains their classes made. 

Table 8 

READING GAINS BY MORNING OR AFTERNOON CLASSES 



Teacher 


Morning 


Afternoon 


Pre 


Post 


Gain 


Pre 


Post 


Gain 


G 


6.2 


6.4 


0.2 


6.0 


6.7 


0.7 


R 


6.3 


6. 6 


0.3 


6.4 


6 . 6 


0.2 


L 


6.1 


6.6 


0.5 


6.5 


7.1 


0.6 



The results are too anomalous to comment on at any length. 

2. Each of the three math teachers taught two classes in the 
morning, two in the afternoon. Table 9 presents these gains. 
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Table 9 

ARITHMETIC GAINS BY MORNING OR AFTERNOON CLASSES 



Teacher 


Morning 


Afternoon 


Pre Post Gain 


Pre Post Gain 


T 


6.6 6.9 0.3 


6.7 7.0 0.3 




6.5 6.6 0.1 


6.6 6.9 0.3 


X 


6.6 6.9 0.3 


6.5 7.0 0.5 




6.5 6.9 0.4 


6.6 6.7 0.1 


E 


6.2 6.7 0.5 


6.9 7.1 0.2 




6.4 6.6 0.2 


6.4 6.9 0.5 



These results also shed no light on the problem. 

3. The final comparison is between those, students who had a three- 
hour block of R-3, humanities, and reading with one teacher in the morn- 
ing and those who had this in the afternoon. Six teachers taught the 
blocks. Table 10 presents these data. No differences can be attrib- 
uted to time of day. 



Table 10 

READING GAINS BY THREE-HOUR BLOCK, 
MORNING OR AFTERNOON 



Morning 


Afternoon 


Pre 


Post 


Gain 


Pre 


Post 


Gain 


6.2 


6.8 


0.6 


6.0 


6.6 


0.6 


6.1 


6.6 


0.5 


6.0 


6 .4 


0.4 


5.6 


5.8 


0.2 


6.1 


6.3 


0.2 



Caveat 

We have perhaps strained the limits of these analyses. We wisli to 
reiterate that this was done only to illustrate how we intend tc treat 
the data from a full year’s participation in the program. We think 
that these are the kinds of analyses that provide decisionmakers with 
useful information on which to base program changes. 
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Other Data 

Since it is generally accepted that regular attendance and few dis- 
cipline infractions are indicative of a good attitude toward school, we 
collected data on the students’ attendance, referrals, and suspensions. 

Because the program students had been at WWJHS the fall semester, 
we were able to use them as their own controls. We compared their re- 
cords for the fall and spring semester, i.e,, before the program was 
initiated and during its semester of operation. 

Attendance , Absences increased considerably during the second se- 
mester, We have no systematic explanation for this. If we exclude the 
22 students who accounted for 962 absences, total absences for the sec- 
ond semester decreased slightly. However, because we do not have this 
kind of detailed breakdown by student for the first semester, we do not 
feel justified in making the exclusion. Table 11 presents the dat^ on 
absences for both semesters. 

Table 11 



COMPARISON OF ATTENDANCE RECORD, FIRST AND SECOND SEMESTERS 





Students in 
Program 


Number of 
Absences 


Days per 
Semester 


Absences per 
Student-Day a 


Girls 


Boys 


Total 


Girls 


Boys 


Total 


Girls 


Boys 


Total 


Semester 

First 


118 


139 


257 


867 


1,108 


1,975 


89 


0.083 


0.090 


0.086 


Second 


113 


131 


244 


1,344 


1,548 


2,892 


90 


0.132 


0.131 


0.132 



Percent of change in attendance +59 +46 +53 



2 

The divisors in these ratios are total potential student days; ab- 
sences have not been subtracted. 



ERIC 



Referrals , The number of referrals for both boys and girls de- 
creased during the second semester. As in past reports, we have our 
reservations about the reliability of these data. The question always 
arises as to whether we are objectively assessing student behavior or 
merely reporting teacher tolerance for deviations from their normal be- 
havior standards. Table 12 shows referrals. 



28 - 
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Table 12 

COMPARISON OF REFERRAL RECORD, FIRST AND SECOND SEMESTERS 





Students 

with 

Referrals 


Number of 
Referrals 


Referrals per 
Student-Day 


Referrals per 
Referred Student 


Referred 
Students/ 
Total Students 




Girls 


Boys 


Girls 


Boys 


Girls 


Boys 


Total 


Girls 


Boys 


Total 


Girls 


Boys 


Total 


Semes ter 




























First 


34 


70 


163 


237 


.016 


.019 


.018 


4.8 


3.4 


3.8 


.29 


.50 


.40 


Second 


38 


59 


103 


128 


.010 


.011 


.011 


2.7 


2.2 


2.4 


.34 


.45 


.40 


Change , % 


+12% 


-16% 


-37% 


-46% 


-33% 


-42% 


-39% 


-44% 


-35% 


-37% 


+17% 


-10% 


0 



The divisors in these ratios are total potential student days; absences have 
not been subtracted. 



The 3 R-3 math teachers who met each student for 1 hour daily made 
37 referrals. Seven R-3 teachers, who met with students from 1 to 3 
hours daily, made 45 referrals; 2 R-3 teachers made none. All 12 R-3 
instructional aides accounted for 7 referrals. There was a total of 
89 referrals from within the program. 

Three elective teachers, who met with program students 3 times a 
week, made 7 referrals; 2 physical education teachers, who met with 
students daily, made 22; and the music teacher, who saw the students 
once a week, made 92 referrals. There were 21 other unidentified re- 
ferrals from outside the program, for a total of 142. 

That there were fewer referrals from within the program may re- 
flect reduced class size or perhaps a greater effort on the part of 
the program teachers to deal with discipline problems without recourse 
to official sanctions. 

Suspensions . During the first semester, nine students were sus- 
pended — three girls and six boys. During the second semester, when 
students were in the R-3 program, there were six suspensions — one girl 
and five boys. Although this decrease is small, it is a trend in the 
right direction. 
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Teacher Impressions of Student Behavior 

In an attempt to assess some of the nonquant itative features cf 
the R-3 program, teachers were requested to submit subjective evalua- 
tions of student attitude and behavior change. These evaluations were 
made in early March and in June. Each teacher was asked to report any 
significant observations about each student. In June, they were ad- 
ditionally asked to indicate any changes in student attitude or behav- 
ior that they perceived since the start of the program. 

The subjective nature of the evaluations and the great variety 
of the responses make a meaningful summary difficult. Consequently, 
we can report only general impressions and illustrative samples. 

In reporting their observations, the tendency of most teachers 
was to formally or informally structure their responses. One teacher 
systematically reported reading level, attendance, and behavior for 
each student. The others tended to fall into Informal patterns of re- 
sponding, noting similar types of information for each student. Typ- 
ically, two, three, or four factors were mentioned by each teacher for 
each student. These factors often included ability, achievement, be- 
havior, attitude, personality, participation, physical appearance, and 
attendance. In addition, teachers frequently compared individual stu- 
dents with class norms. In June, teachers also compared terminal 
characteristics with initial characteristics, or in some instances, 
characteristics during the previous semester. 

With regard to ability, teachers indicated in a variety of terms 
that the student was above average, average, or below average. The 
majority of students were reported as being average or above average. 

A small number were reported as being very bright or very slow. Many 
of the responses, particularly in June, indicated that several teachers 
were somewhat surprised at the abilities of their students. Some re- 
ported that students were achieving more than test scores indicated 
they should. Others indicated that deficiencies in basic skills, poor 
attendance, or lew motivation — rather than lack of ability— were the 
explanations for poor scores, low achievement, and negative attitudes. 




30 
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Achievement, in terms of test performance or other objective 
classroom measures, was rarely reported- Most teachers who indicated 
achievement reported the student was working harder, doing more prob- 
lems, or completing more assignments- A few exceptions did occur. One 
reading teacher reported the reading level in March in terms of grade 
placement. Another teacher reported improvements in oral reading abil- 
ity. With regard to math, one teacher reported achievement in terms of 
the student's mastery of addition, subtraction, multiplication, and 
division skills. The paucity of comments regarding achievement is due 
largely to the fact that teachers were instructed to direct their atten- 
tion to behavioral and attit.udinal observations. 

Behavior and attitude were well covered. Most teachers identi- 
fied student behavior as cooperative, uncooperative, or variable. Those 
who were considered cooperative were generally cited as quiet, serious, 
respectful, helpful, and hard workers. Those categorized as uncoopera- 
tive were often described as talkative, playful, disrespectful, rude, or 
hostile. A large number, whose behavior varied, were described as typi- 
cal teenagers, moody, or emotionally unstable. A frequent observation, 
particularly for the uncooperative or variable student, was the nega- 
tive influence of peer pressures. Teachers often reported students as 
good, hard workers when seated by themselves or when their friends were 
absent, but talkative and playful when part of a group. There were 
several instances, however, where heterogeneous grouping was cited as a 
constructive measure in reducing the negative aspects of peer pressure. 
Several teachers reported that they had discussed behavior problems in- 
dividually with students and that these students often voluntarily 
changed their seats to be nearer good or serious students. In some in- 
stances, the heterogeneous grouping was mentioned with regard to social 
patterns. In a few instances, teachers reported the formation of new 
friendships and social groups. In one instance, a teacher related how 
one of his below-aver age girls changed seats and developed a friendship 
with a boy who was an above-average student. As the friendship grew, 
the girl's behavior and performance on assignments greatly improved. 
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Several teachers also mentioned the effects of heterogeneous group- 
ing on the more capable students. Many indicated that some brighter 
students were intolerant of the less-capable students and very impa- 
tient with them in group activities. This was particularly mentioned 
by R-3 teachers. Academically, some teachers also indicated that 
brighter students became bored with assignments while other students 
were still challenged. 

Overall, the majority of teachers reported a general improvement 
in the behavior of their students. Many reported a reduction in talk- 
ing, aggression, fooling around, and rudeness toward adults and other 
students. Teachers often indicated a strong relationship between the 
change in behavior and a change in attitudes. Many of these teachers 
felt the changes in attitudes Old behavior were attributable to compo- 
nents of the program. The in tensive -involvement trip was most fre- 
quently cited as the cause of dramatic and positive changes in atti- 
tude and behavior. In the March evaluation, L.S. was reported as a 
"loud-mouth troublemaker .. .difficult to motivate. " In June, however, 
the same teacher reported that "this semester, especially after the 
intensive involvement, he has really begun to work. . . . [L. S. ] has 
become one of my best students ... tardies and other minor behavior 
problems have diminished also. 11 Another teacher reported that L.S. 
had developed a great deal of self-control with peers and the teacher. 

A third teacher reported he had become Cooperative and reasonably 
quiet. ..even pleasant to me. 11 

In another case, teachers reported T.H, initially to be a poor 
student with little endurance and low achievement. In June, teachers 
reported "a pleasant change in [T.H.] since the intensive involvement. 

He [T.H.] is really involved in the class now. He is no longer sullen 
or hostile. In fact, he comes in the room with a smile and often gets 
so involved with the game that he works right into his break." His 
math teacher reported that he had become his "fastest student" and 
that he did "fantastic amounts of work" and "huge amounts of homework 
voluntarily." And a third teacher reported that intensive involvement 
had "turned him on." This student was also reported to have an unsat- 
isfactory home environment and several older brothers and sisters who 
were drop outs. 
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Although many of the reports did not indicate such dramatic changes 
in attitude, a large number indicated positive changes in attitudes to- 
ward teachers and peers that seemed to generalize and continue in the 
classroom. Most teachers reported that changes in attitude and behav- 
ior persisted throughout the semester. Only in a few cases was it re- 
ported that the effects wore off within two to three weeks. And only 
in one case did a teacher report that the student reverted to the be- 
havior he had exhibited during the first class session. 

Some teachers felt that another influential aspect of the program 
was the drama unit they developed. A.R. , reported as "immature, child- 
ish, and playful in class," changed considerably in her reading and 
humanities class. The teacher stated "what a change in this girl! She 
has become almost my right hand man when it is necessary to quiet the 
group so that work can proceed. A drama unit turned her on and she 
hasn’t been turned off since." Another student reported to be moti- 
vated by the drama unit had "shown an increase of maturity, less gig- 
gling and hair combing in class, and a turning to a more serious nature." 

Most of the remarks regarding personality were made in conjunc- 
tion with observations on attitude or behavior. The teachers generally 
indicated that students were shy or outgoing, happy or unhappy, trust- 
worthy or unreliable, friendly or hostile. Many students were initially 
reported as being shy, withdrawn, and unresponsive. Most teachers re- 
ported that these students would work quietly and individually, avoid 
contact with the teacher and the aides, and often avoid contact with 
groups of their peers. In several instances, R-3 teachers reported 
that although they remained shy in other situations, these students 
increasingly participated in R-3 activities. 

Although participation might be considered as an aspect of per- 
sonality and behavior, many teachers reported it as a separate factor. 

In general, teachers reported the greatest enthusiasm and frequency 
of participation from their average and above-average students. Many 
reported significant increases in both participation and eagerness 
following the intensive involvement. And, as discussed above, read- 
ing teachers noted similar changes following a drama unit. 
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Most remarks dealing with physical appearance were made in con- 
junction with social or behavioral problems. Of those students re- 
ported to have physical handicaps, most were reported to have personal 
problems and poor relationships with their peers. None of the teach- 
ers reported significant changes in attitude or behavior for these 
students during the course of the program. Various aspects of the 
program, particularly the group activities, were often reported to ag- 
gravate the social problems of these students. Many of these students 
did not participate in the intensive involvement although the school 
nurse assured their parents that they were capable of participating. 
Several teachers indicated that over— protective parents were part 
of their students* problems. 

Attendance was commonly reported. Many teachers indicated the 
total days absent but did not state reasons for the absences. Others 
indicated attendance in general terms — good, fair, poor — and offered 
impressions about the reasons for absenteeism. In general, those 
teachers commenting on attendance indicated a reduction in the number 
of absences for students with chronically poor attendance records. 

Only in a few cases did teachers report severe increases in absentee- 
ism. For these students, teachers reported that they were losing 
ground and that the cases seemed hopeless. In most of these situa- 
tions, teachers cited parents as a contributing cause to absenteeism. 
After home visits or phone calls, teachers felt parents were too in- 
dulgent and that they would allow students to stay home for any rea- 
son. They also reported that some parents kept students home for 
housework or babysitting. 

Parent Evaluation 

Since only about 20 percent of the parents returned the question- 
naire, we feel that their opinions may not accurately reflect the ma- 
jority of parents. Nevertheless, we report the results of those who 
completed the evaluation: 

Forty-two parents thought the project was worthwhile; four did not 

Forty-three parents thought it helped their children; three did 





not . 
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When asked to compare R-3 to regular classes, 28 thought it much 
better, 10 somewhat better, 5 equal, and 2 Xijorse. 

Forty-two parents would like their children to be in an eighth- 
grade R-3 class; four would not. 

Thirty-seven would like to see all classes at WWJHS in the proj- 
ect; eight would not. 

Of the parents who wrote comments, eight were favorable, two un- 
favorable, and one was ambivalent. 



ERLC 
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III * OPINIONS OF PROGRAM PERSONNEL 



We conducted several inte 'lews with teachers and program direc- 
tors during the semester* M e wanted to elicit from those persons re- 
sponsible for implementing the program their opinions as to its strengths 
and weaknesses so that we could use this information for suggesting 
improvements* This section presents their reactions to the program* 



D O YOU THINK THE PROGRAM HAD DIFFERENT IMPACTS ON FACILITATING 
ACHIEVEMENT FOR DIFFERENT ABILITY LEVELS? 

The R-3 component went over better with the slower students; the 
brighter students didn’t think it was worthwhile for them* 

Some of the very slow students were frustrated because they 
couldn’t do the things the more able could* 

We need to do more to challenge the brighter students; more 
thought has to be given to selecting advanced reading materials* 

The brighter students want as much individual attention as do 
the less able* 

Our reading program really didn’t get properly underway until 
after the individual diagnostic tests* 

There are too many R-3 lessons which depend heavily on the 
teacher talking and explaining* The students need an opportunity to 
work by themselves* 



WHAT DO YOU SEE AS THE RELATIVE STRENGTHS AND WEAKNESSES OF 
HETEROGENEOUS GROUPING VERSUS TRACKING? 



In R-3 and the humanities, we were able to team the less with 
the more able. 

The less capable at least tried to participate in discussions 
because they had models in the brighter students. 

The slower students have grown immensely in an atmosphere where 
stupidity and bizarre actions are not tolerated* 

Tracking is much easier for the teacher* 

Having a wide range of students served as a catalyst to develop 
a broadly based math curriculum* 

It’s hard to keep track of where 20 students are working. 

The slower students tend to be disruptive after they reach the 
end of their attention span, but the brighter students "sat on" them. 

It provides the mechanism for bringing about individualized in- 
struction because no lesson or exercise is appropriate for the en- 
tire group, 

O 
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WHAT DO YOU THINK THE PROGRAM ACHIEVED IN THE NONCOGNITIVE 
AREAS ? 

Since the intensive involvement, the students have been more 
friendly toward the teachers. 

Students have learned a great deal about working together in 
groups. They are beginning to understand team work. 

In math I was able to provide success experiences for the slow 
learners by giving them work they could do and challenge the brighter 
students by giving them work they had trouble with. 

The program provided many opportunities for oral work. 

In the small group, the students got to know each other well 
enough so that most of them weren't afraid to talk in class. 

We removed a lot of frustrations by giving students a chance to 
talk about how they felt. This, in turn, reduced disciplinary prob- 
lems because they weren't so up- tight. 



THE INTENSIVE INVOLVEMENTS WERE A NEW EXPERIENCE FOR YOU. 
WHAT IS YOUR REACTION TO THEM? 



It was great because we weren’t doing the teaching. 

It gave us a different role, which helped our image. We didn’t 
have to worry about getting the message across and could be more 
friendly. 

I had to make an effort to involve myself; I felt like a fifth 
wheel. I was dying to be in the teacher role. 

Teachers doing the instruction would be better. When you’re 
teaching, discipline is secondary to the instruction. 

We were put in a bad light as observers and watchdogs. 

Having teachers and aides do the instruction would keep them 
in a position where they have to relate to the students at all times. 

It was a chance for the students to be with their peers in a 
new, different and exciting situation. 

We really had a chance to sit down and talk to our students. 

My worst problem- chi Id has been a changed person since the in- 
volvement^ he’s been like a young adult since our return. 

Something happens between students and teachers that really 
helps teachers. There’s a new spirit of cooperation in my room now. 

There was a nice blend of cognitive and noncognitive activi- 
ties. There was enough school work to make the students concentrate; 
there were enough simple activities to provide success experiences 
for the slower students. 

The involvement humanized the. teachers for the students. 
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It provided excellent opportunity for student interaction in 
small groups. 

It was a pleasant educational experience for the students. 

We may have tipped some of the fence-sitters in the right 
direction , 

Students got a much better appreciation of environmental prob- 
lems by observing, than they could have gotten from reading or 
lectures , 

Those who chose not to go won’t miss the next one. 

We won’t ever be so concerned again about taking our problem 
students; most of them behaved beautifully, 

WHAT DO YOU THINK WAS THE STRONGEST FEATURE OF THE PROGRAM? 

The opportunity to work individually with each student. 

The freedom from a structured syllabus, 

I like the relevance of R-3, 

(Everyone) Small classes, aides, intensive involvement. 



WHAT DO YOU THINK WAS THE WEAKEST FEATURE OF THE PROGRAM? 

The short field trips were generally not well planned. 

Three classes in a row in the same room with the same students 
it’s not good for them or us. 

Not enough guidance on how to use an aide. 

The diagnostic testing was done too late in the program. 

Coordination between the teachers. 

The humanities component. 



HOW DO YOU THINK THE PROGRAM CONTRIBUTED TO YOUR PROFESSIONAL 
GROWTH? 



I have become a more flexible teacher, 

I have learned to go with the students, rather than trying to 
drag them along with me, 

I found that I was a great deal more adaptable than I thought 
I was, 

I’ve learned a great deal about working with other teachers as 
a group, I have learned to wait and see what others want to do 
rather than imposing my own views. 
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The program has forced me to be specifically analytical of stu- 
dents and their problems# My approach has been more prescriptive 
than it usually is. 

I think the program helped me become a better reading teacher. 

I’ve learned to be more tolerant of other people’s problems. 
I’ve become more patient. 

DID YOUR EXPOSURE TO THE GAMING-SIMULATION (R-3) COM P ONENT 
STIMULATE YOU TO TRY INNOVATIONS ON YOUR OWN? 



Yes — it had never occurred to me to play in the classroom before. 

Yes — because you can use techniques in small classes that you 
can’t use in a large one. 

No — after an hour of R-3, I found them ready for a change of pace. 

Yes — we used some games in math and the students responded nicely 
because they were used to it. 

Yes — it got you in the habit of gaming. I put together some 
phonic games in reading, for example, that I never would have thought 
of without the program. 



9c 9c * 9c 9c * 



The material cited in this section is illustrative only. It is 
intended as a demonstration of the kinds of information an evaluation 
staff can get about a program. The interview information is used to 
help forestall incipient problems during the course of the program. 

It is considered during the summer to strengthen the program’s next 
iteration. 
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IV. EVALUATION FOR PROGRAM IMP ROVEMENT 



In previous sections, we presented data on achievement gain, 
attitudinal change, and reactions of program staff to the various com- 
ponents of the program. 

Here, we present our recommendations^ for changes in the organization 
and structure of the program. They are based on the analysis of the 
data, suggestions from the program personnel, and the observations of 
the evaluation staff. 

PROGRAM COORDINATION 

In-house communication and coordination of the program components 
need revision and strengthening. It is in this area that we see the 
largest qualitative difference between the original, small, R-3 program 
and the current, expanded version* In the previous program, the Direc- 
tor and the two teachers were in continuous communication with each 
other and with LMSC for material development. 

By expanding from 2 to 12 teachers, a new structure seems to be 
indicated. Despite 43 meetings of different combinations of staff and 
directors, at the end of the term some teachers still say they do not 
understand the R-3 component. The entire staff feels the need for 
better coordination among the four components so that their classroom 
activities are focused on the same objectives. 

Whereas the solution to the problem needs to come from the program 
personnel, we would like to present some ideas for their consideration. 

* If all program teachers played all the games in the R-3 simu- 
lations, they would have an opportunity to analyze the skills involved 
and plan their classroom activities to build and reinforce these 
skills. 

* The program director could meet with each group of teachers 
(R-3, math, reading, humanities) once a week to discuss the implementa- 
tion of a coordinated program. He would act as the synthesizer of 
information and as a resource teacher to guide these planning activities. 

^ These recommendations are marked with an asterisk. 
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Sin ce the program scheduling allows each teacher three periods a day 
for planning and preparation, and since all teachers of a given sub- 
ject are free the same period, this should not pose a scheduling 
problem. 

* Arrangements might be made to have the math teachers lead the 
gaming-simulation activities for improvement of math skills. This 
would not only give them a firsthand demonstration of how the R-3 
component operates, but it would also give them an opportunity to ob- 
serve the strengths and weaknesses of their students in handling math 
concepts in an applied situation. 

* The humanities curriculum should be strengthened to reinforce 
both the reading and R-3 components. 

ORIENTING STUDENTS TO R-3 

In discussing with teachers how to strengthen the orientation to 
the seventh-grade program, several suggestions were made that deserve 
consideration : 

* When students enter the program, it should be carefully ex- 
plained to them. In particular, the role of gaming needs clarifica- 
tion. Many students did not understand that the gamin g-simul at ion is 
a learning device. 

- The fun aspect of R-3 should be de-emphasized in the orienta- 
tion. Many students expected nothing but good times and it was diffi- 
cult to change their expectancy. 

* The orientation might include some discussion of the use of 

achievement tests as a tool to diagnose the areas where students need 
help. This might serve two purposes: remove the element of fear if 

it exists for any of the students, and elicit their cooperation in 
doing their best. At the same time, they might be taught the mechan- 
ics of test-taking so that their performance is not hampered by a 
lack of know-how in following directions and marking answer- sheets. 




ALLOCATION OF STUDENTS TO CLASSES 

In the interests of replication, students were assigned to class 
groups on the basis of only two criteria: entering achievement scores 
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to insure heterogeneity within each group, and sex to provide a bal- 
ance between boys and girls in each group. 

During the course of the program, it became apparent that certain 
combinations of students exerted a disruptive influence on an entire 
class. If one of the students in the combination was absent, not only 
did the entire class function more smoothly but the other member of 
the combination did not cause trouble and seemed to profit from 
instruction . 

* In planning for continuing this program with the same students 
in the eighth grade, some thought must be given to devising an objec- 
tive system for breaking up disruptive combinations without destroying 
the mix of achievement represented in each class. We think this prob- 
lem should be addressed during the summer months so that the regrouping 
can be done before school starts. 

* Two other aspects of this problem should be considered simul- 
taneously. (1) The desirability of creating entirely new class groups 
for the eighth grade, taking account of breaking up undesirable com- 
binations. (2) Making a decision as to whether the original pre-test 
scores or the June 1970 post-test scores should be used in allocating 
students to classes. We assume that whatever decision is made in this 
instance would hold for the ninth grade; this should be considered 
when examining the issue. 

FACILITATING ACHIEVEMENT GAIN 

Several teachers referred to working with different (generally 
three) ability groups. We got the definite impression that they were 
literally tracking within the classroom. 

* Since this is not the intent of the program, we suggest that 
particular attention be paid to working with program teachers to help 
them plan individual programs for their students. There is certainly 
no objection to grouping students with the same deficiencies for in- 
tensive remedial work — but this grouping should not remain static. 

* The objectives of each activity should be explained to the 
students before it is undertaken; their accomplishment should be dis- 
cussed after the activity. 
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* Diagnostic reading tests should he administered during the 
first two weeks of school* 

* Provisions should he made for the brighter students to do some 
research projects keyed to the R-3 activities* They need an opportun- 
ity to work independently. 

* Since the top readers do not need a development program, atten- 
tion should be given to meeting their particular needs* Such areas as 
building inference -making skills, improving study skills, and in-depth 
reading in areas of their own interest might provide the basis for 
strengthening this aspect of the reading program. 

IDENTIFYING GIFTED STUDENTS 

Two or three teachers mentioned that one of their students should 
be in a gifted program. * Perhaps R-3 could be used as an identifying 
program for students who would benefit from SJUSD T s gifted program. 

With small classes and varied activities, teachers see their students 
in many situations and should be able to make an accurate assessment. 

It would be a mistake to skim all the top students from the pr' 6 ram be- 
cause they serve as good models for the lower achievers. But the pro- 
gram might provide a good situation in which to identify talented 
disadvantaged students* 

HOME VISITS 

* Along with systematic home visits to gain parental support for 
the program, more emphasis should be placed on seeking parental coop- 
eration in regular school attendance* This may be a sensitive although 
worthwhile area. 

* The few parents who responded negatively to the evaluation 
questionnaire should be visited by the Program Director. 

R OLES OF PROGRAM PERSONNEL 

Rather than a teacher and an aide for 20 students, might there be 
some gains from using a teacher and 2 aides for 30 students? There 
is no evidence to suggest that reducing class size per se contributes 
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to achievement gain. There is no measure to ascertain whether class 
reduction is having an effect on achievement in this program. Most 
often, a teacher uses the same kinds of techniques no matter what the 
class size; i.e., a teacher who relies heavily on lectures will lec- 
ture whether he has 7, 17, or 70 students. 

From observation only, we are not convinced that teachers in the 
program are changing their approach sufficiently to achieve the objec- 
tives of the program. If a teacher is working with two instructional 
aides, his role must change to that of a director of learning activi- 
ties for his students, his task, in addition to providing instruction., 
becomes one of coordinating the efforts of the aides. 

By scheduling daily meetings with the aides to plan the day’s in- 
struction, we see two consequences of possible advantage to the stu- 
dent. First, progress would be systematically checked every day so 
that no time is wasted on fruitless activities. Second, instruction 
for each child would have to be individually planned. 

We would like to see the program directors give some considera- 
tion to the pros and cons of this type of instructional situation. 
Although it may be neither feasible nor desirable to implement it, 
discussing its implications may lead to a reconsideration of how the 
teacher’s role might be enhanced. ' 

* There seems to be a need to reassess and possibly redesign the 
roles of the Director and Assistant Director. We are aware that there 
was no time for preplanning before the program started and that roles 
simply evolved. Thus, many of this semester’s problems should not re- 
cur. Nevertheless, the experiences of the semester should be reviewed 
because they provide some basis for knowing what to expect. Tasks 
that needed much attention this year will be performed routinely next 
year. Some planning for overall program management may contribute to 
a smoother operation. 

Intensive Involvements 

* The intensive involvements seem to need restructuring in the 
area of role definition and allocation of responsibilities. Most 
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teachers indicated that — despite the fact that they were given an in- 
struction sheet, "Role of Teachers and Aides During Intensive Involve- 
ment" — they were uncertain about what was expected of them. Furthermore, 
they felt that no one person had overall responsibility for the opera- 
tion. (This probably reflects the fact that Dr. R. G. Pisano, a Con- 
sultant from San Jose State College, was responsible for implementing 
the learning activities he designed, and the R-3 Assistant Director was 
responsible for recreation and "housekeeping.") It does suggest the 
need for better communication between directors and teachers so that 
there is no future confusion. 

* There was unanimity on the desirability of having the involve- 
ment at the beginning of the program. By choosing a site closer to 
San Jose, the duration could be cut to two days and two groups a week 
could go — perhaps one Monday and Tuesday, the other Wednesday and Thurs- 
day. In this way, relationships between teachers and students could 

be established at the very outset of the program. 

* Although the teachers were divided in their opinions about doing 
the instruction on the involvements or having San Jose State College 
students as instructors, the feasibility of running the involvements 
without student instructors should be explored. It is necessary to 
weigh the benefits to be derived from using outside subject-matter ex- 
perts against those to be derived from using persons adept in human 
relationships. Since Dr. Pisano was able to train two of the instruc- 
tional aides to act as group leaders, it seems reasonable to assume that 
a great program improvement could be realized by having teachers in this 
role. Besides cutting the cost of the involvement, it would resolve 

the ambiguity of the teacher’s role and insure their interaction with 
students . 

We strongly recommend that this strategy be closely examined from 
the standpoint of facilitating -replication, decreasing cost, and better 
accomplishing the objectives of the intensive involvements. Although 
learning is an important factor, it is subordinate to improving teacher- 
student relationships. 





